Method for generating and reproducing multimedia content, electronic device for performing same, and recording medium in which program for executing same is recorded

ABSTRACT

Method for displaying multimedia content, electronic device for performing same, and recording medium in which program for executing same is recorded are disclosed. In one embodiment, a method for displaying multimedia content comprises acquiring multimedia content including video data which is reproduced as a video, and slide data including a key scene which is matched with event time point in a reproduction time period of the video data and is displayed in a slideshow manner, acquiring a text data corresponding to the multimedia content, displaying the multimedia content in a first area according to a video mode for reproducing the video data as the video or a slideshow mode for displaying the key scene in the slideshow manner, displaying at least a portion of the text data in a second area; and adjusting the displayed text data according to the displayed multimedia content.

TECHNICAL FIELD

The present invention relates to a method for generating and reproducingmultimedia content, an electronic device for performing the same, and arecording medium having a program for executing the same stored therein,and more particularly, to a method for generating and reproducingmultimedia content reproduced in a video manner or a slideshow manner,an electronic device for performing the same, and a recording mediumhaving a program for executing the same stored therein.

BACKGROUND ART

These days, along with the development of communication technology andvideo processing technology, multimedia content is routinely utilized.Together with this tendency, there are frequent requests for anintelligent user interface that enables viewers of a variety ofmultimedia content to select desired scenes from the multimedia contentand immediately view the scenes.

Users want to exclude advertisements in multimedia content, portionsthat have already been viewed, or portions that are not of interest andwant to begin watching the multimedia content from a desired time point.However, when an analog apparatus such as a conventional video tape isused, random access to a desired point thereof is physically impossible.Thus, a user should directly check and access the desired portion byusing a fast forward function. Recently, due to digital technology formultimedia content, it has become possible to immediately access adesired reproduction point with high accuracy.

However, fast forward (FF) and fast rewind (FR) functions used forhigh-speed search of digital content require many user inputs in orderto move to an accurate position desired by a user. Also, a user must payattention to the reproduction of media in order to check whethermovement is made to a precise desired position. Also, a pre-existingsearch method is not appropriate when a user wants to quickly watch onlykey scenes by skipping to them.

DETAILED DESCRIPTION OF THE INVENTION Technical Problem

An object of the present invention is to provide a content reproductionmethod capable of selecting key scenes of content reproduced as a videoand reproducing the selected key scenes as a slideshow, and anelectronic device for performing the same.

An object of the present invention is to provide A method for displayingmultimedia content capable of providing multimedia content that can beselectively reproduced according to any one of a video mode and aslideshow mode in conjunction with text for the multimedia content suchas a subtitle or an article, an electronic device for performing thesame, and a recording medium having a program for executing the samestored therein.

Another object of the present invention is to provide a multimediacontent generation method capable of capturing a video with a camera inreal time or reading a video prestored in a memory and generatingmultimedia content that can reproduce the video as it is or reproducekey scenes of the video in a slideshow manner, an electronic device forperforming the same, and a recording medium having a program forexecuting the same stored therein.

Another object of the present invention is to provide A method fordisplaying multimedia content capable of providing summary informationof text so that a user may easily understand all details of the text anddirectly view a desired text section, an electronic device forperforming the same, and a recording medium having a program forexecuting the same stored therein.

The objects of the present invention are not limited to theaforementioned objects, and other objects which are not described hereinshould be clearly understood by those skilled in the art from thefollowing detailed description and the accompanying drawings.

Technical Solution

According to an aspect of the present invention, there is provided Amethod for displaying multimedia content including acquiring multimediacontent including image data; acquiring event information regardingevent time points matched on a timeline of the content; reproducing thecontent in any one reproduction mode between a video mode, in which thecontent is reproduced as a video, and a slideshow mode, in which keyscenes of the content are sequentially displayed as still images,wherein the key scenes are images corresponding to the event timepoints; switching the reproduction mode to the slideshow mode when afirst input having a first type is received while the video mode beingis performed, wherein when the slideshow mode is entered from the videomode, the playback time point is set as a first event time point closeto a playback time point on the timeline at which the first input isreceived, and a key scene corresponding to the first event time point isdisplayed; and maintaining the reproduction mode as the slideshow modeand shifting the playback time point when a second input having thefirst type is received while the slideshow mode is being performed,wherein the playback time point is shifted to a second event time pointclose to a playback time point on the timeline at which the second inputis received, and a key scene corresponding to the second event timepoint is displayed.

According to an aspect of the present invention, there is provided amethod for generating multimedia content that is output in a video modeand a slideshow mode, the method including acquiring video content;reproducing the video content in real time; receiving a scene selectioninput from a user while the video content is being reproduced;generating an event time point in a reproduction section of the videocontent on the basis of the scene selection input; acquiring a key scenefrom the video content on the basis of the event time point; andgenerating multimedia content by matching the key scene with the eventtime point of the video content.

According to another aspect of the present invention, there is providedan electronic device for generating multimedia content that is output ina video mode and a slideshow mode, the electronic device including adisplay configured to output an image; an input unit configured toreceive an input from a user; and a control unit configured to acquirevideo content, reproduce the video content through the display in realtime, receive a scene selection input from a user through the input unitwhile the video content is being reproduced, generate an event timepoint in a reproduction section of the video content on the basis of thescene selection input, acquire a key scene from the video content on thebasis of the event time point, and generate multimedia content bymatching the key scene with the event time point of the video content.

According to still another of the present invention, there is provided arecording medium having a program for executing the above-describedmultimedia content generation method stored therein.

The technical solutions of the present invention are not limited to theaforementioned solutions, and other technical solutions which are notdescribed herein should be clearly understood by those skilled in theart from the following detailed description and the accompanyingdrawings.

According to an embodiment of the present invention, there is provided Amethod for displaying multimedia content including acquiring multimediacontent including video data which is reproduced as a video, and slidedata including a key scene, wherein a key scene is matched with an eventtime point in a reproduction time period of the video data and isdisplayed in a slideshow manner; acquiring a text data corresponding tothe multimedia content; displaying the multimedia content in a firstarea according to a video mode for reproducing the video data as thevideo or a slideshow mode for displaying the key scene in the slideshowmanner; displaying at least a portion of the text data in a second area;and adjusting the displayed text data according to the displayedmultimedia content.

According to another aspect of the present invention, there is providedan electronic device including a display displaying an image; and acontroller configured to acquire multimedia content including video datawhich is reproduced as a video, and slide data including a key scene,wherein a key scene is matched with an event time point in areproduction time period of the video data and is displayed in aslideshow manner, acquire a text data corresponding to the multimediacontent, display the multimedia content in a first area according to avideo mode for reproducing the video data as the video or a slideshowmode for displaying the key scene in the slideshow manner, display atleast a portion of the text data in a second area; and adjusting thedisplayed text data according to the displayed multimedia content.

According to still another of the present invention, there is provided acomputer-readable recording medium having a program for executing theabove-described multimedia content display method stored therein.

The technical solutions of the present invention are not limited to theaforementioned solutions, and other technical solutions which are notdescribed herein should be clearly understood by those skilled in theart from the following detailed description and the accompanyingdrawings.

Advantageous Effects of the Invention

According to the present invention, by providing a slideshow manner inwhich key scenes are sequentially shown as still images as well asreproducing content capable of being reproduced as a video, it ispossible to quickly enjoy all of the content mainly with the key scenes.

According to the present invention, it is possible to generatemultimedia content capable of being produced in a slideshow mode as wellas a video mode from a video.

According to the present invention, it is possible to generatemultimedia content capable of being reproduced as a video captured witha camera in real-time or a video prestored in a memory or produced askey scenes of the video in a slideshow manner.

The advantages of the present invention are not limited to theaforementioned advantages, and other advantageous effects which are notdescribed herein should be clearly understood by those skilled in theart from the following detailed description and the accompanyingdrawings.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an electronic device according to anembodiment of the present invention.

FIG. 2 is a schematic diagram of a data structure of multimedia contentaccording to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a structure of comment data accordingto an embodiment of the present invention.

FIG. 4 is a diagram showing details of comment data according to anembodiment of the present invention.

FIG. 5 is a diagram showing an example of selecting a key sceneaccording to an embodiment of the present invention.

FIG. 6 is a diagram showing another example of selecting a key sceneaccording to an embodiment of the present invention.

FIG. 7 is a diagram showing still another example of selecting a keyscene according to an embodiment of the present invention.

FIG. 8 is a diagram showing a slide shifting according to an embodimentof the present invention.

FIG. 9 is a diagram showing a bookmark shifting according to anembodiment of the present invention.

FIG. 10 is a diagram showing entry into a slideshow mode according to anembodiment of the present invention.

FIG. 11 is a diagram showing an example of a multimedia content displayscreen according to an embodiment of the present invention.

FIG. 12 is a diagram showing a request for entering a slideshow mode oran input for a slide shifting according to an embodiment of the presentinvention.

FIG. 13 is a diagram showing a bookmark setting input according to anembodiment of the present invention.

FIG. 14 is a diagram showing a bookmark indication according to anembodiment of the present invention.

FIG. 15 is a diagram showing an example of a matching relationship amongvideo data, a key scene, and comment data according to an embodiment ofthe present invention.

FIGS. 16 and 17 are diagrams showing examples of a multimedia contentdisplay screen provided together with a comment according to anembodiment of the present invention.

FIGS. 18 and 19 are diagrams showing other examples of a multimediacontent display screen provided together with a comment according to anembodiment of the present invention.

FIGS. 20 and 21 are diagrams showing still other examples of amultimedia content display screen provided together with a commentaccording to an embodiment of the present invention.

FIGS. 22 and 23 are diagrams showing examples of a multimedia contentdisplay screen provided together with a comment and summary informationaccording to an embodiment of the present invention.

FIG. 24 is a flowchart of A method for displaying multimedia contentaccording to an embodiment of the present invention.

FIGS. 25 to 27 are diagrams showing still other examples of selecting akey scene according to an embodiment of the present invention.

FIGS. 28 to 30 are diagrams showing examples of a comment datageneration operation according to an embodiment of the presentinvention.

FIG. 31 is a diagram showing a default screen for a content reproductionmethod according to an embodiment of the present invention.

FIG. 32 is a diagram showing a user input for mode switching accordingto an embodiment of the present invention.

FIG. 33 is a diagram showing a change in subtitle attributes in aslideshow mode according to an embodiment of the present invention.

FIG. 34 is a diagram showing a visual effect of a slide shifting in aslideshow mode according to an embodiment of the present invention.

FIG. 35 is a diagram showing an example of a slide shifting method in aslideshow mode according to an embodiment of the present invention.

FIG. 36 is a diagram showing omission of a slide icon in a slideshowmode according to an embodiment of the present invention.

FIG. 37 is a diagram showing bookmark setting in a slideshow modeaccording to an embodiment of the present invention.

FIG. 38 is a diagram showing an example of a user interface for settinga bookmark in a slideshow mode according to an embodiment of the presentinvention.

FIG. 39 is a diagram showing a touch input for a bookmark shiftingaccording to an embodiment of the present invention.

FIG. 40 is a diagram showing displaying of a bookmark list according toan embodiment of the present invention.

FIG. 41 is a diagram showing a subtitle event browser according to anembodiment of the present invention.

BEST MODE

Embodiments described in this specification are made to clearly explainthe scope of the invention to those having ordinary skill in the art andare not intended to limit the present invention. It should beinterpreted that the present invention may include substitutions andmodifications within the technical scope of the present invention.

Terms used herein have been selected as general terms which are widelyused at the present in consideration of the functions of the presentinvention, but may be altered according to the intent of an operator ofordinary skill in the art, conventional practice, or the introduction ofnew technology. However, when a specified term is defined and used in anarbitrary sense, a meaning of the term will be described separately.Accordingly, the terms used herein are not to be defined as simple namesof the components, but should be defined based on the actual meaning ofthe terms and the whole context throughout the present specification.

The accompanying drawings are for facilitating the explanation of thepresent invention and a shape in the drawings may be exaggerated for thepurpose of convenience of explanation, thus the present invention is notto be limited to the drawings.

In addition, details of generally known functions and structures whichobscure the subject matter of the present invention will be omitted.

According to an embodiment of the present invention, there is provided Amethod for displaying multimedia content including acquiring multimediacontent including video data which is reproduced as a video, and slidedata including a key scene, wherein a key scene is matched with an eventtime point in a reproduction time period of the video data and isdisplayed in a slideshow manner; acquiring a text data corresponding tothe multimedia content; displaying the multimedia content in a firstarea according to a video mode for reproducing the video data as thevideo or a slideshow mode for displaying the key scene in the slideshowmanner; displaying at least a portion of the text data in a second area;and adjusting the displayed text data according to the displayedmultimedia content.

Also, the adjusting may include refreshing the displayed text data.

Also, the adjusting may include performing an operation including atleast one of a scrolling, a up-and-down moving of the text, aup-and-down shifting of the page, and a page turning on the displayedtext data.

Also, the text data may include a text section linked to the event timepoints, and the adjusting may include displaying a text section linkedto the event time point corresponding to a playback time point of thevideo data reproduced in the video mode in the second area.

Also, the text section may include at least one paragraph unit.

Also, the event time point corresponding to the playback time point mayinclude at least one of the event time point identical to the playbacktime point in a reproduction section and the event time point positioneddirectly before the playback time point.

Also, the method for displaying multimedia content may further include auser input from a user indicating at least one of a scrolling, aup-and-down moving of the text, a up-and-down shifting of the page, anda page turning on the displayed text data; performing an operation onthe text data according to the user input; and shifting the playbacktime point of the video data to an event time point to which the textsection displayed in the second area is linked according to theoperation.

Also, the method for displaying multimedia content may further includepausing the reproduction of the video data when shifting the playbacktime point.

Also, the method for displaying multimedia content may further includereceiving a user input from a user indicating at least one of ascrolling, a up-and-down moving of the text, a up-and-down shifting ofthe page, and a page turning be performed on the text data from a userwhile the multimedia content is being displayed in the video mode;performing an operation on the text data according to the user input;shifting the playback time point of the video data to an event timepoint to which the text section displayed in the second area is linkedaccording to the operation; and displaying the key scene which ismatched with the event time point linked to the text section displayedin the second area and switching from the video mode to the slideshowmode.

Also, the text data may include a text section linked to the key scene;and the adjusting comprises displaying a text section linked to a keyscene displayed in the slideshow mode in the second area.

Also, the text section may include at least one paragraph unit.

Also, the method for displaying multimedia content may further includereceiving a user input from a user indicating at least one of ascrolling, a up-and-down moving of the text, a up-and-down shifting ofthe page, and a page turning be performed on the displayed text datafrom a user; performing an operation on the text data according to theuser input; and displaying the key scene linked to the text sectiondisplayed in the second area according to the operation.

Also, the text data may include a text section linked to the event timepoints and a summary information of a text section.

Also, the displaying of the text data may include displaying the textsection linked to an event time point corresponding to one of a playbacktime point of the video data reproduced in the video mode and the keyscene displayed in the slideshow mode; and displaying the summaryinformation of the text sections except for the displayed text section.

Also, the displaying of the text data may include displaying the textsection linked to an event time point corresponding to any one of aplayback time point of the video data reproduced in the video mode andthe key scene displayed in the slideshow mode; and displaying thesummary information of the text sections except for the displayed textsection.

Also, the method for displaying multimedia content may further includereceiving a user input selecting the summary information; displaying thetext section according to the selected summary information; and settingthe playback time point of the video data in the video mode ordetermining the key scene displayed in the slideshow mode on the basisof an event time point to which the text section is linked.

Also, the method for displaying multimedia content may further includereceiving a user input indicating the bookmark from a user while themultimedia content is being displayed in the slideshow mode; andbookmarking a key scene displayed when the user input is received.

According to another aspect of the present invention, there is providedan electronic device including a display displaying an image; and acontroller configured to acquire multimedia content including video datawhich is reproduced as a video, and slide data including a key scene,wherein a key scene is matched with an event time point in areproduction time period of the video data and is displayed in aslideshow manner, acquire a text data corresponding to the multimediacontent, display the multimedia content in a first area according to avideo mode for reproducing the video data as the video or a slideshowmode for displaying the key scene in the slideshow manner, display atleast a portion of the text data in a second area; and adjusting thedisplayed text data according to the displayed multimedia content.

According to still another of the present invention, there is provided acomputer-readable recording medium having a program for executing theabove-described multimedia content display method stored therein.

<Electronic Device>

An electronic device 1000 according to the present invention may displaymultimedia content.

Here, multimedia content refers to content composed of video datareproduced as a video and slide data formed by collecting key scenes ofthe video data. As necessary, the multimedia content may refer tocontent that additionally includes a subtitle in the form of text orcomment data in the form of an article with respect to the video data orthe key scenes.

The electronic device 1000 according to the present invention maydisplay the video data or slide data that has been described in a videomanner or a slideshow manner and may also appropriately display thecomment data as the multimedia content.

The electronic device 1000 according to an embodiment of the presentinvention will be described below with reference to FIG. 1 .

FIG. 1 is a block diagram of the electronic device 1000 according to anembodiment of the present invention. Referring to FIG. 1 , theelectronic device 1000 according to an embodiment of the presentinvention may include an input unit 1100, an output unit 1200, acommunication unit 1300, a memory 1400, and a controller 1500. Thecomponents of the electronic device 1000 will be sequentially describedbelow.

The input unit 1100 may receive a user input from a user. The user inputmay include a key input, a touch input, a voice input, and various otherinputs. As an example, the input unit 1100 for receiving such a userinput is a comprehensive concept including a touch sensor for detectinga touch of a user, a microphone for receiving a voice signal, a camerafor recognizing a gesture or the like through image recognition, aproximity sensor composed of an illumination sensor or infrared sensorfor detecting an approach of a user, a motion sensor for recognizing amotion of a user through an acceleration sensor, a gyro sensor or thelike, and various other input units for detecting or receiving varioususer inputs, as well as a typical key pad, a typical keyboard, and atypical mouse. Here, the touch sensor may be implemented as a resistiveor capacitive touch sensor which detects a touch through a touch panelor a touch film attached to a display panel, an optical touch sensorwhich detects a touch in an optical manner, etc.

In addition, the input unit 1100 may be implemented in the form of aninput interface (a USB port, a PS/2 port, etc.) which connects anexternal input device that receives the user input to the electronicdevice 1000 instead of an apparatus which autonomously detects the userinput.

The output unit 1200 may output various kinds of information and providethe information to a user. The output unit 1200 is a comprehensiveconcept including a display for outputting an image, a speaker foroutputting a sound, a haptic device for generating vibration, andvarious other output units. In addition, the output unit 1200 may beimplemented in the form of a port-type output interface for connectingthe above-described individual output units to the electronic device1000.

Here, as an example, the display may display text, a still image, and avideo. Moreover, the display is a broad concept of an image displaydevice, including a liquid crystal display (LCD), a light emitting diode(LED) display, an organic light emitting diode (OLED) display, a flatpanel display (FPD), a transparent display, a curved display, a flexibledisplay, a three-dimensional (3D) display, a holographic display, aprojector, and various other devices for performing an image outputfunction. The display may be a touch display formed integrally with atouch sensor of the input unit 1100.

The communication unit 1300 may communicate with an external device.Thus, the electronic device 1000 may transmit or receive various kindsof information to or from the external device. Here, the communication,that is, the transmission or reception of data, may be performed in awired or wireless manner. To this end, the communication unit 1300 maybe configured as a wired communication module for accessing the Internetor the like through a local area network (LAN), a mobile communicationmodule for accessing a mobile communication network via a mobilecommunication base station to transmit or receive data, a short-distancecommunication module using a wireless local area network (WLAN)communication method such as Wi-Fi or a wireless personal area network(WPAN) communication method such as Bluetooth and Zigbee, a satellitecommunication module using a Global Navigation Satellite System (GNSS)such as a Global Positioning System (GPS), or a combination thereof.

The memory 1400 may store various kinds of information. The memory 1400may temporarily or semi-permanently store data. Examples of the memory1400 may include a hard disk drive (HDD), a solid state drive (SSD), aflash memory, a read-only memory (ROM), a random access memory (RAM),etc. The memory 1400 may be built into or detachable from the electronicdevice 1000.

An operating system (OS) for driving the electronic device, variouskinds of programs needed or used to drive the electronic device 1000according to an embodiment of the present invention, such as anapplication program for reproducing multimedia content as a video orshowing the multimedia content in a slideshow manner according to Amethod for displaying multimedia content, which will be described below,various kinds of data regarding the multimedia content, such as thevideo data, the slide data, and the comment data, to be referenced bythese programs, and metadata to be linked to the multimedia content byan application program, such as bookmark information or the like, may bestored in the memory 1400.

The controller 1500 controls overall operation of the electronic device1000. To this end, the controller 1500 may calculate and process variouskinds of information and may control operation of the components of theelectronic device 1000.

The controller 1500 may be implemented as a computer or the like withhardware, software, or a combination thereof. The controller 1500 may beimplemented with hardware and provided in the form of an electroniccircuit for processing an electrical signal to perform a controlfunction, and may be implemented with software and provided in the formof a program for driving the hardware controller 1500.

In the following description, unless otherwise specified, the operationof the electronic device 1000 may be interpreted as being performedunder the control of the controller 1500.

The above described electronic device 1000 may load and reproducemultimedia content.

Here, the multimedia content, which is content including, for example,video data encoded according to various kinds of MPEGs or various othervideo codecs and slide data including key scenes of a video, may referto content capable of being reproduced in the video mode or theslideshow mode.

The electronic device 1000 may reproduce such multimedia content in twomodes, that is, the video mode for reproducing multimedia content as avideo and the slideshow mode for reproducing key scenes of a video asstill images in a slideshow manner.

Also, when multimedia content is reproduced in the video mode or theslideshow mode, the electronic device 1000 may display a commenttogether with an image with reference to the comment data.

A method for generating and reproducing such multimedia content will bedescribed in detail below.

<Date Structure of Multimedia Content>

A data structure of multimedia content according to an embodiment of thepresent invention will be described below first before a method fordisplaying the above-described multimedia content is described.

FIG. 2 is a schematic diagram of a data structure of multimedia contentaccording to an embodiment of the present invention.

In the present invention, the multimedia content may include video dataand slide data. Also, the multimedia content may additionally includethe comment data. Here, the video data, the slide data, and the commentdata may generally be present in the form of a single integrated file,but some data may be present in the form of a separate file asnecessary. As a detailed example, the video data, the slide data, andthe comment data may be present as a single file, or the video data andthe slide data may be present as a single file while the comment datamay be present as a separate file. It should be appreciated that fileformats other than the above example are possible.

The video data of the multimedia content may be formed as well-knowngeneral video data. For example, the video data may be data regarding aplurality of image frames that are encoded to implement a video bysequentially outputting images according to MPEG, H.264, or any one ofvarious other video codecs. When the codec is decoded in the video modeby the electronic device 1000, the video data may be reproduced as avideo through a display-type output unit 1200.

Also, the slide data of the multimedia content may be configured as aset of key scenes corresponding to still images of a video at specifiedtime points. Here, an entire reproduction section of the video dataaccording to the present invention may be classified into a plurality ofevent sections EV-1, EV-2, EV-3, EV-4, . . . , EV-(n−1), EV-n, and thekey scenes may refer to still images SC-1, SC-2, SC-3, SC-4, . . . ,SC-(n−1), SC-n representing the event sections. In the slideshow mode,the slide data may be sequentially displayed in a slideshow manner bythe electronic device 1000.

Also, the comment data of the multimedia content may refer to commentcorresponding to the above-described event sections. Here, the commentsmay be mainly provided in the form of text. The comments may correspondto the event sections on a one-to-one basis. However, for some of theevent sections, no comment may correspond to the event section, or aplurality of comments may correspond to the event sections. Referring toFIG. 2 , it can be seen that two comments CM-2 a and CM-2 b correspondto the second event section EV-2 and no comment corresponds to thefourth event section EV-4. The comment data may be displayed in the formof a subtitle in the video mode or may be displayed in the form of aslide annotation in the slideshow mode. Alternatively, unlike this, thecomment data may be displayed in the form of an article in a regionother than a region at which a video or a slide image is displayed inthe video mode or the slideshow mode. In the case of displaying in theform of an article, an operation such as scrolling or page turning maybe performed automatically to display an appropriate comment accordingto progress of a video or a slide show.

<Structure of Comment Data>

A detailed structure of such comment data will be described below withreference to FIGS. 3 and 4 .

FIG. 3 is a schematic diagram of a structure of comment data accordingto an embodiment of the present invention, and FIG. 4 is a diagramshowing details of comment data according to an embodiment of thepresent invention.

The comment data may include a header and a body. Various kinds ofinformation needed to output a comment or other additional informationmay be included in the header. Examples of the information needed tooutput a comment may include a font type, a size, a style, a color, adisplay position, or the like of text, and examples of the additionalinformation may include a comment title, comment generator information,a date of generation, or the like. In FIGS. 3 and 4 , it can be seenthat the various kinds of information needed to output the comment andthe additional information are described between “[HEADER]” and“[EVENT]”.

The body may be composed of a start field, an event field, and an endfield. The start field and the end field indicate a start and an end ofthe event field, respectively, and information regarding text to beoutput while the multimedia content is being displayed and regarding anevent section in which details of the text should be displayed may becontained in each event field. Here, the information regarding an eventsection may be defined by a start time point and an end time point ofthe event section. Here, an event time point may be defined as aspecified time point between the start time point and the end time pointof the event section. As an example, the event time point may be definedas the start time point of the event section or a time point apredetermined time after the start time point.

In detail, bookmark check information, event section information, andtext information may be included in the event field.

First, the text information is associated with text to be displayed, andgenerally has the form of a character string. The event sectioninformation may refer to a time section at which the text is displayed.As an example, the event section information may include start timepoint information and end time point information of the event section asshown in FIGS. 3 and 4 . In this case, the character string of thecomment text may be displayed from the start time point to the end timepoint. Of course, if the time length of the event section is set at apredetermined time interval, the event section information may includeonly the start time information of a comment.

The bookmark check information is an identifier for checking whether acorresponding event section (or event time point) is bookmarked. Forexample, according to the comment data of FIG. 4 , “The SeoulMetropolitan . . . (omission) . . . K-pop and fashion” is displayed as acomment from “0:00:05.65” to “0:00:12.79” in the entire reproductionsection of the multimedia content. Also, it can be seen that “MARKED”indicating that an event section corresponding to a range from“0:0053.25” to “0:01:22.51” is bookmarked.

In some cases, the event field may have no text information, or the textinformation may have the form of blank without a character stringcontained therein. In this case, a corresponding event section may haveno comment.

<Video Data and Slide Data>

A relationship between the video data and the slide data will bedescribed below.

According to an embodiment, the slide data may be obtained from thevideo data in consideration of an event time point. The event time pointmay be obtained with reference to the comment data or may be separatelydesignated by a user. The event time point information, which isinformation that serves as a link among the video data, the slide data,and the comment data, may be included in the data or stored in the formof a separate file. For convenience of description, however, it isassumed that the comment data includes the event time point information.

Here, the video data may be received from an external device or may beprestored in and loaded from the memory 1400. For example, the videodata may be streamed or downloaded from an external multimedia server(not shown) or may be received by the electronic device 1000 from acamera (not shown) for capturing an image in real time. Alternatively,the electronic device 1000 may prestore video data in the memory 1400,and the controller 1500 may load the video data from the memory 1400. Insome cases, the electronic device 1000 may edit or generate videocontent to be used to generate multimedia content from original videodata by using a video editing tool or a video generating tool.

Similarly, the comment data may be downloaded from an external device,loaded from the memory 1400, or generated through a comment editing toolof the electronic device 1400.

FIG. 5 is a diagram showing an example of selecting a key sceneaccording to an embodiment of the present invention.

As an example, a still image at a time point corresponding to a starttime point of an event section (hereinafter referred to as an “eventtime point”) in a reproduction section of video data may be selected asa key scene, as shown in FIG. 5 . The electronic device 1000 may readstart time point information of the event section from the comment dataand may select, as a key scene, a still image corresponding to the eventtime point in the reproduction section in which the video data isreproduced as a video.

The still image corresponding to the start time point of the eventsection has been described as being selected as the key scene, but thereis no need to select the start time point as the key scene. For example,in some cases, the electronic device 1000 may select, as the key scene,a still image corresponding to a time point a predetermined time beforeor after the start time point of the event section or a still imagecorresponding to an end time point of the event section. In particular,when the comment data is generally utilized as a subtitle, the starttime point of the event section may be set a little earlier or laterthan voice synchronization of a video corresponding to the subtitle.Accordingly, it may be effective to move a time point of a key scene apredetermined time up or back from the start time point of the eventsection.

Key scenes have been described as being selected corresponding to eventsections on a one-to-one basis. Alternatively, the number of key scenesselected may be less than or greater than the number of event sections.

As an example, a single key scene may be selected for a plurality ofevent sections. For example, when the event sections are denselypositioned in terms of time, that is, when comments are consecutivelydisplayed for a short time, the electronic device 1000 may select asingle key scene for the dense consecutive comments rather than a keyscene for each of the event sections. Here, event sections being denselypositioned in terms of time may refer to a case in which a plurality ofevent sections are within a predetermined time interval, a case in whicha start time point of a previous event section is the same as an endtime point of a current event section, or the like.

FIG. 6 is a diagram showing another example of selecting a key sceneaccording to an embodiment of the present invention.

In FIG. 6 , one key scene is shown as being selected for a plurality ofevent sections when the event sections are dense and present on atimeline of a reproduction section. In detail, a single key scene “#x”may be selected for event sections “#x1” and “#x2,” and a single keyscene “#y” may be selected for four event sections “#y1”, “#y2”, “#y3”,and “#y4.”

As another example, a plurality of key scenes may be selected for asingle event section, unlike the above description in which the singlekey scene is selected for the plurality of event sections. For example,when a length of an event section, that is, an interval between a starttime point and an end time point of the event section, is longer than apredetermined time interval, several key scenes may be selected for theevent section. In this case, the key scenes may be selected in regardsto start time points of a certain number of parts into which the entirelength of the event sections is divided. Alternatively, the key scenesmay be selected in regards to the start time points of the event sectionand time points a predetermined time after the start time points.

FIG. 7 is a diagram showing still another example of selecting a keyscene according to an embodiment of the present invention.

In FIG. 7 , a key scene “#z1” is shown as being selected for a starttime point of a long event section “#z” on a timeline, and a key scene“#z2” is shown as being selected for an intermediate point between astart time point and an end time point of the long event section “#z.”

A key scene may be selected in consideration of a size of textinformation of an event section. For example, when a character stringcontained in text information of an event section has a certain lengthor more, several key scenes may be selected for the event section. Forexample, when a single key scene is selected for 30 characters, threekey scenes may be selected for 80 characters of a character stringincluded in a comment of an event section. Conversely, when there are aplurality of consecutive event sections each having a comment in which acharacter string contained in text information has a certain length orless, a single key scene may be selected for the consecutive eventsections. For example, when five event sections each having a characterstring composed of four characters are consecutively arranged on atimeline, a single key scene may be selected for the five eventsections.

The selected key scene may be extracted from a still image of video datadisplayed at an event time point. The key scene may be the same image asthe still image of the video data or may be obtained by processing thestill image of the video data.

When key scenes are acquired, the key scenes may be collected togenerate the slide data. By default, the slide data may include eventsection information regarding a plurality of key scenes and an eventsection (or event time point) in a reproduction section of video data towhich each of the key scenes is linked.

The slide data may have a dummy file structure that actually includesonly the event section information without the still images of the keyscenes. When such slide data is used, a core image may be extracted as astill image from video data that is reproduced in real time by simplyusing only the event section information.

When slide data is generated in this way, the electronic device 1000 maygenerate multimedia content by merging or interconnecting the video dataand the slide data. In detail, the video data is data that is encoded tobe reproduced as a video, and the slide data may include key scenesmatching event time points (or event sections) which are specific timepoints in the reproduction section of the video. Additionally, thecomment data may be merged or interconnected therewith. In this case,like the slide data, the comment data may include comments matching theevent time points (or event sections) which are specific time points inthe reproduction section of the video.

Such multimedia content may be selectively reproduced in the video modeor the slideshow mode, as will be described below.

<Multimedia Content Display Operation>

A display operation of multimedia content according to an embodiment ofthe present invention will be described below. For convenience ofdescription, the above-described display operation will be described asbeing performed by the above-described electronic device 1000. Unlessotherwise specified, it may be interpreted that operation of theelectronic device 1000 is controlled by the controller 1500. It shouldbe appreciated that the display operation is not limited by theabove-described electronic device 1000 and may be performed using anelectronic device that is similar to the above-described electronicdevice 1000.

<Slideshow Mode>

The slideshow mode in which key scenes selected as described above aresequentially shown as still images will be described below. The videomode is operated similarly to a method for generally reproducing a videothrough a well-known multimedia content player (e.g., Windows MediaPlayer), and thus a detail description thereof will be omitted.

In the slideshow mode, key scenes may be sequentially displayed as stillimages in a slideshow manner Here, the slideshow manner may refer to amethod for outputting a specified key scene as a still image and thenreceiving a user input or automatically outputting a following orpreceding key scene as a still image.

As described above, in the slideshow mode, a slide shifting function maybe provided to sequentially output the key scenes.

FIG. 8 is a diagram showing a slide shifting according to an embodimentof the present invention.

Here, a slide shifting refers to a change from a specific key scene,which is a still image, to the following or preceding key scene.Referring to FIG. 8 , it is shown that in the slideshow mode, a slideshifting is performed from a specific key scene to the following orpreceding key scene. In the slideshow mode, a shifting between keyscenes may be performed with reference to the comment data. In detail,when an input for a slide shifting occurs, a slide shifting between keyscenes may be performed on the basis of a current playback time point ona timeline corresponding to the input, for example, a start time pointof a comment corresponding to a key scene, by searching the comment datafor a comment corresponding to a time point on the timeline directlybefore or after the current playback time point and outputting a keyscene corresponding to the found comment as a still image.

Also, when a still image is output in this way in the slideshow mode,comment text of a comment corresponding to a key scene may also beoutput. When a plurality of comments correspond to a single key sceneand the key scene is output as a still image, text of the plurality ofcomments may be displayed on a single screen. Conversely, when aplurality of key scenes correspond to a single comment, the text of thecomment may be divided and matched to each main scene.

As described above, when the slideshow mode is used, a user can identifydetails of corresponding content for a short time while viewing keyscenes and comments without watching an entire video.

In the slideshow mode, instead of a sequential shifting among the keyscenes a bookmark shifting function for a shifting only among scenesbookmarked from among key scenes may be provided.

Here, a bookmarked key scene may be a key scene that is selectedcorresponding to a comment bookmarked when a key scene is selected usingthe comment data.

Alternatively, in the slideshow mode, a bookmark may be set for a keyscene. In detail, when a user input for bookmark setting occurs while astill image of a specific key scene is being output in the slideshowmode, the key scene may be set as a bookmarked key scene. When the userinput for bookmark setting occurs as described above, informationindicating that a comment corresponding to a still image being output isa bookmarked comment may be recorded in a comment bookmark check field.

Also, the bookmark setting may be performed at any time point duringreproduction in the video mode. In detail, when the user input forbookmark setting occurs while content is being reproduced as a video, animage at a playback time point corresponding to the user input may beset as a bookmarked core image. When a bookmark is set at any time pointas described above, a comment having a corresponding time point as astart time point is generated in comment data and recorded in thebookmark check field as a bookmarked comment. Such a comment has textinformation processed as a blank (a vacant comment) or has no textinformation.

When a bookmark is set, additional information regarding a bookmarkedkey scene may be generated in addition to the bookmarked key scene beingset. For example, when the input for the bookmark setting is receivedfrom a user, the electronic device 1000 may provide a text input windowto a screen thereof and then receive a character string from the user.In this case, the received character string may be stored as textinformation of a comment corresponding to a bookmarked key scene.Accordingly, when the bookmarked key scene is displayed later, thecharacter string received from the user may additionally be displayed inthe form of a subtitle.

As described above, a shifting between bookmarks may be possible whenthe bookmark is set. FIG. 10 is a diagram showing a bookmark shiftingaccording to an embodiment of the present invention. Referring to FIG.10 , when an input for shifting between bookmarked key scenes occurs,the shifting between the bookmarked key scenes may be performed on thebasis of a current playback time point on a timeline corresponding tothe input by searching the comment data for a bookmarked commentcorresponding to a time point on the timeline directly before or afterthe current playback time point and outputting a key scene correspondingto the found bookmarked comment as a still image. Here, the search forthe bookmarked comment may be performed by examining the commentbookmark check field.

<Entry into Slideshow Mode>

An operation of entering the above-described slideshow mode will bedescribed below.

In order to reproduce multimedia content in the slideshow mode, thecontent may be reproduced in the slideshow mode from the beginning. Insome cases, a reproduction mode of the content may be switched to theslide show mode while the content is being reproduced in the video mode.

When the content is reproduced in the slideshow mode from the beginning,the content is reproduced by reproducing several key scenes as stillimages through a slide shifting beginning with the first key scene on atimeline. However, when an input for a user requesting entry into theslideshow mode occurs while the content is being reproduced in the videomode, the reproduction mode thereof is changed to the slideshow manner.

When the video mode is switched to the slideshow mode in this way, theslideshow mode may be entered on the basis of a playback time pointcorresponding to the switching by outputting a key scene correspondingto a time point on the timeline directly before or after the playbacktime point as a still image.

FIG. 9 is a diagram showing entry into the slideshow mode according toan embodiment of the present invention. Referring to FIG. 9 , it can beseen that when the video mode is switched to the slideshow mode, a keyscene corresponding to a time point on the timeline directly before orafter a playback time point corresponding to the switching is reproducedas a still image.

<User Interface in Slideshow Mode>

Various kinds of user interfaces for performing an operation associatedwith the above-described slideshow mode will be described below.

A default screen for a multimedia content display operation will bedescribed first before a user interface is described in detail. Thedefault screen may be provided through the output unit 1200 of theelectronic device 1000.

FIG. 11 is a diagram showing an example of a multimedia content displayscreen according to an embodiment of the present invention. Referring toFIG. 11 , a display window, a progressive bar, a control panel, a slideicon, and a bookmark icon may be included in the default screen.

A key scene may be displayed in the display window as a still image.Also, in a portion of the display window, a subtitle region in which acomment is displayed may be positioned over the still image. Also, iconsfor various kinds of user inputs (for reproducing, stopping, pausing,rewinding, and fast-forwarding a video) which are used in the video modemay be arranged on the control panel. Also, a bar corresponding to areproduction time period of an entire video and an icon indicating acurrent playback time point on the bar are positioned on the progressivebar.

The slide icon may be positioned on left and right sides of the displaywindow. The slide icon is associated with a user input performing aslide shifting during the slideshow mode. Also, the bookmark icon isassociated with a user input for bookmark setting.

Various kinds of functions may be performed in the multimedia contentdisplay operation through a user input or touch input for selecting anicon provided by the default screen.

First, the video mode may be switched to the slideshow mode as follows.

When a user input selecting a slide icon is received from a user whilecontent is being reproduced in the video mode, the electronic device1000 may change a reproduction mode of the content from the video modeto the slideshow mode. In detail, when a user input selecting a rightslide icon is received, the slideshow mode is entered by displaying akey scene corresponding to a time point on a timeline directly after aplayback time point corresponding to the reception in the video mode asa still image. When a user input selecting a left slide icon isreceived, the slideshow mode is entered by displaying a key scenecorresponding to a time point on the timeline directly before a playbacktime point corresponding to the reception in the video mode as a stillimage.

Alternatively, when a horizontal drag touch input is applied in thevideo mode, the electronic device 1000 may switch the reproduction modeto the slideshow mode. FIG. 12 is a diagram showing a user input formode switching according to an embodiment of the present invention. Areproduction mode may be switched when a drag touch input is applied toa subtitle region. In detail, it may be determined that the drag touchinput is applied to the subtitle region when a start time point of thetouch input is within the subtitle region. Here, depending on ahorizontal movement direction of the drag touch input, it may bedetermined whether to output a key scene before or after a playback timepoint of a video on a timeline as a still image when the slideshow modeis entered. For example, as shown in FIG. 12 , when a direction of thetouch input is rightward, a key scene after the playback time point onthe timeline at which the touch input is received may be output. FIG. 12also shows selection of a slide icon for a slide shifting, and thus thefollowing description refers to FIG. 12 .

When the video mode is entered from the slideshow mode as describedabove, the default screen may be partially changed. As an example, theslideshow mode may have different comment attributes from the videomode. Comment attributes may refer to a font size, a color, a font type,and a display position of a comment. As an example, when the slideshowmode is entered, a text font size may increase in comparison to thevideo mode.

It is also possible to change from the slideshow mode back to the videomode. In this case, a video may be reproduced immediately from aplayback time point of a slideshow. Alternatively, the video may bereproduced from a time point a predetermined time interval before theplayback time point of the slideshow. Thus, the video may be naturallyreproduced.

In the slideshow mode, a slide shifting between key scenes may beperformed in a manner similar to the mode switching. In other words, theslide shifting may be performed by the slide icon being selected or ahorizontal drag touch being applied.

In the slideshow mode, a slide shifting between key scenes may generatea visual effect in which a screen is changed in a sliding way.

For example, when a drag touch input is received in the slideshow mode,a current key scene moves in a display window in a direction of the dragtouch input, and a key scene to be displayed is output to an empty spacecaused by the slide shifting. In this case, the movement of the keyscene is proportional to a length of the drag. In this case, when amovement distance of the key scene is greater than or equal apredetermined distance, that is, when an end of the current key sceneexceeds a predetermined boundary, the slide shifting is performed.Conversely, when the drag touch input ends before the slide shifting isperformed, the slide shifting may not be performed.

When the slide shifting is repeated, a final key scene among several keyscenes may be output as a result. In this case, a user may be informedthat the current key scene is the last key scene through the defaultscreen. For example, when the final key scene is reached, the electronicdevice 1000 may omit a slide icon for shifting to a following key scenefrom the default screen. Conversely, a slide icon for shifting to apreceding key scene may not be displayed while the first key scene isbeing output.

Next, the bookmark setting will be described. FIG. 22 is a diagramshowing a bookmark setting in the slideshow mode according to anembodiment of the present invention. According to FIG. 22 , when a userinput selecting a bookmark icon of the default screen occurs, a bookmarkmay be set for a current playback time point in the video mode or theslideshow mode. When a bookmark is set in this way, a correspondingscene is set as a bookmarked key scene. Referring to FIG. 22 , it can beseen that a bookmark is set for a comment for a corresponding key scene.

Also, when a bookmark is set in this way, a character input window forgenerating additional information may be provided. When a characterstring is input into the window by a user, text may be displayedtogether with a corresponding comment. The text that is input as theadditional information may be displayed to have different commentattributes from original comments. When a bookmark is set for a positionat which there is no comment, a dummy comment is generated.

A bookmark shifting using a bookmark that is set in this way may beperformed as follows. FIG. 13 is a diagram showing a bookmark settinginput according to an embodiment of the present invention. A bookmarkshifting may be performed according to a horizontal drag touch input.Here, the bookmark shifting may be performed when a drag touch input isapplied to a subtitle region. However, such a drag touch input may referto a movement of a predetermined distance or more in a horizontaldirection. In other words, the above-described slide shifting andbookmark shifting may be distinguished depending on a drag distance. Forexample, when a drag is performed for less than the predetermineddistance, the slide shifting may be performed. When the drag ismaintained for more than the predetermined distance, the bookmarkshifting may be performed. As in a case of the slide shifting, whetherto shifting to a preceding or following bookmark may be set according toa drag direction.

The electronic device 1000 may display a list of bookmarked key scenes.FIG. 14 is a diagram showing a bookmark indication according to anembodiment of the present invention. Referring to FIG. 14 , in theslideshow mode, images of bookmarked key scenes may be listed anddisplayed. For example, when a vertical drag touch input is applied(e.g., in a downward direction), the electronic device 1000 may move adisplay window down according to a degree of the drag, list bookmarkedcore images in chronological order, and display the listed core imagesin an empty space in which the display window was positioned.

In this situation, when an image is selected from among the listedimages by a user, a playback time point may be shifted to a still imageof the bookmarked core image, and the still image may be displayed.

When a horizontal drag touch occurs while the bookmarks are beingdisplayed, the listing of the bookmarks may be released.

The above-described slideshow mode may be executed using contentpre-stored in the memory 1400 of the electronic device 1000. However, insome cases, the slideshow mode may be executed while data regardingcontent is being received from an external device in a streaming manner.For example, the data regarding the content may be transmitted throughthe communication unit 1300 of the electronic device 1000 from anexternal device, and the electronic device 1000 may temporarily storethe data regarding the content in a buffer and reproduce the contentwhile reading the buffer.

Here, the electronic device 1000 may receive a still image of a keyscene to be displayed in the slideshow mode first. Generally, in a videostreaming service, video data for playing a video is sequentiallyreceived beginning with a playback time point. However, according to thepresent invention, a still image of a key scene may be transmittedearlier than the video data is received. The still image of the keyscene has a much smaller size than a video. Accordingly, even when it isdifficult to reproduce content as a video due to a low transmissionrate, the electronic device 1000 may reproduce content in the slideshowmode by receiving a key scene first. To this end, the electronic device1000 may receive the comment data first.

When still images of a key scene are acquired first as described above,the still images may be received in order from a still image closest toa current playback time point to smoothly play a slideshow.

<Comment Data Display Operation>

The video mode and the slideshow mode that use the video data and theslide data, respectively, have been described. However, the commend datamay be additionally output in the video mode and the slideshow mode.

FIG. 15 is a diagram showing an example of a matching relationship amongvideo data, a key scene, and comment data according to an embodiment ofthe present invention.

Referring to FIG. 15 , as described above, the multimedia content mayinclude video data having event sections, slide data including keyscenes, and comment data having text sections in a reproduction section.Here, the event sections, the key scenes, and the text sections may belinked or matched to interwork with each other. Here, the eventsections, the key scenes, and the text sections may interwork with eachother through an event time point.

The linked information may be used to reproduce a video with referenceto the video data and display text sections linked to an event sectionto which a playback time point belongs in the video mode or to displaykey scenes in a slideshow mode and display text sections linked to thekey scenes in the slideshow manner

<Display of Comment Data>

FIGS. 16 and 17 are diagrams showing examples of a multimedia contentdisplay screen provided together with a comment according to anembodiment of the present invention.

The comment data may be largely displayed in the form of a subtitle oran article. Generally, when the text data is displayed in the form of asubtitle, a comment window may be included in a display window in theform of a subtitle region, and text may be displayed in a form in whicha video or a core image overlays the subtitle.

Conversely, the text data may be displayed in the form of an article. Inthis case, the display window, in which a video or a key scene is to bedisplayed on a screen, and the comment window, in which text sectionsare to be displayed, may be separately displayed.

Referring to FIG. 16 , it can be seen that a key scene or the video datais displayed in the display window and a text section is displayed inthe comment window. In FIG. 16 , a first key scene is displayed in thedisplay window, and a first text section linked thereto is displayed inthe comment window. In addition, a control panel for performing ashifting between playback time points or key scenes, startingreproduction or stopping reproduction, a bookmark setting, etc. in thevideo mode or the slideshow mode and a progressive bar for indicating aposition of an image that is being displayed in the display window in areproduction section may be displayed on the screen.

When a second key scene is displayed by a key scene shifting input whilethe first key scene is being displayed as shown in FIG. 16 , the secondkey scene may be displayed in the display window after the first keyscene, and also the second text section linked to the second key scenemay be displayed in the comment window, as shown in FIG. 17 . Also, whenthe second text section is displayed as shown in FIG. 17 while the firsttext section is being displayed as shown in FIG. 16 , text of thecomment window may be scrolled, vertically moved in units of a row, orturned in units of a page.

FIGS. 16 and 17 show examples in which only a text section linked to akey scene that is being displayed is displayed in a comment window.However, alternatively, other text sections may be additionallydisplayed in the comment window. For example, the text sectioncorresponding to the key scene in the display window may be displayed inan upper portion of the comment window, and then a following textsection may be additionally displayed when the comment window has anempty space in which text may be displayed.

FIGS. 18 and 19 are diagrams showing other examples of a multimediacontent display screen provided together with a comment according to anembodiment of the present invention.

Referring to FIG. 18 , while a first key scene is being displayed in thedisplay window, a first text section linked thereto may be displayed inan upper portion of a comment window, and then a portion of a secondtext section may be displayed in an empty space of the comment window.When the comment window has an additional empty space in which text maybe displayed even after the second text section is displayed, third andfourth text sections may be additionally displayed.

Also, when a second key scene is displayed by a key scene shifting inputwhile the first key scene is being displayed as shown in FIG. 18 , thesecond key scene may be displayed in the display window, and the thirdtext section may be displayed in the empty space of the comment window,which is the upper portion of the comment window in which the secondtext section is displayed, as shown in FIG. 19 .

Also, when the second text section is displayed as shown in FIG. 19while the first text section is being displayed as shown in FIG. 18 ,text of the comment window may be scrolled, vertically moved in units ofa row, or turned in units of a page.

Unlike the description with reference to FIGS. 16 to 19 , all textsections of the comment data may be displayed in the comment window.Also, among all of the text sections, a text section corresponding to akey scene that is being displayed in the display window may havedifferent display attributes (e.g., a font type, a size, an underline, acolor, etc.) from the other text sections.

FIGS. 20 and 21 are diagrams showing still other examples of amultimedia content display screen provided together with a commentaccording to an embodiment of the present invention.

Referring to FIG. 20 , all text sections of the comment data aredisplayed together with a first key scene. Also, it can be seen that,among the text sections, the first text section matching the first keyscene may be displayed in a color that is different from those of theother text sections. Similarly, referring to FIG. 21 , it can be seenthat a second key scene is displayed in the display window, and also thesecond text section may be displayed in a color that is different fromthose of the other text sections.

By displaying a text section linked to a key scene in the display windowto have different display attributes from the other text sections, auser can be made intuitively aware of a comment regarding an image thatis being displayed in the display window.

It has been described that a key scene is displayed in the displaywindow and a text section is displayed in the comment window in theslideshow mode. However, in the video mode, a video may be displayed inthe display window with reference to video data, and an appropriate textsection may be displayed in the comment window according to a playbacktime point in a reproduction section of the video data. In detail, atext section linked to an event section to which the playback time pointof the video belongs may be displayed in the comment window.

Also, the text section displayed in the comment window may be naturallyscrolled, refreshed in units of a row, or turned and refreshed in unitsof a page according to a change in the playback time point.

<Display of Summary Information>

The summary information may be displayed in addition to a key scene anda text section. Here, summary information may refer to text obtained bysummarizing details of the text section. For example, the summaryinformation may be a title or summary of each text section. Such summaryinformation may be extracted from a key sentence (e.g., the first, thelast sentence, etc.) of a text section and generated by the electronicdevice 1000. It should be appreciated that the summary information maybe separately input by a user.

FIGS. 22 and 23 are diagrams showing examples of a multimedia contentdisplay screen provided together with a comment and summary informationaccording to an embodiment of the present invention.

Referring to FIG. 22 , a display window, a comment window, and a summarywindow may be provided on a screen. Summary information regarding alltext sections may be displayed in the summary window. The summaryinformation may include a number indicating an order of a key scene, atext section, an event section, an event time point (mainly, a starttime point) of the event section, and a tile of the text section.

Also, referring to FIG. 23 , a display window and a comment window maybe provided on the screen. Here, the summary information may bedisplayed in the comment window together with the text section.

By displaying the summary information in addition to the text section, auser can easily be made aware of a brief overview of all text sections.

<Key Scene Shifting Using Text Section or Summary Information>

As described above, according to the present invention, it is possibleto implement a key scene shifting in the slideshow mode or a playbacktime point shifting in the video mode through a user input with regardto a progressive bar, a control panel, or a display window. and it isalso possible to perform the key scene shifting in the slideshow mode orthe playback time point shifting in the video mode through a user inputwith regard to the text section or the summary information displayed inthe comment window.

As an example, when scrolling (e.g., a touch input, a mouse wheelmanipulation, etc.) or a page shifting input (e.g., a touch, a keyboardup key or down key manipulation, a page up or a page down keymanipulation, etc.) is performed on the comment window, a text sectionpreceding or following a current text section may be displayed in thecomment window, and a preceding or following key scene may be displayedin the slideshow mode or a playback time point may be shifted to apreceding or following event time point close to the playback time pointin the video mode in conjunction with the displaying.

Referring back to FIGS. 16 and 17 , when a user scrolls the commentwindow in order to view a following text section while a first key sceneand a first text section are being displayed as shown in FIG. 16 , ashifting may be performed to display a second key scene and a secondtext section as shown in FIG. 17 . In the video mode, a playback timepoint may be shifted to a following event time point close to theplayback time point of FIG. 16 .

Conversely, when a user scrolls the comment window in order to view apreceding text section while the second key scene and the second textsection are being displayed as shown in FIG. 17 , a shifting may beperformed to display the first key scene and the first text section asshown in FIG. 16 . Also, in the video mode, a playback time point may beshifted to a preceding event time point close to the playback time pointof FIG. 17 .

As another example, when all text sections are displayed in the commentwindow, an input for selecting a specified text section may be received,and a key section or a playback time point may be shifted in response tothe input.

Referring back to FIGS. 20 and 21 , when a user selects the second textsection while the first key section and all of the text sections arebeing displayed as shown in FIG. 20 , the second key scene may bedisplayed as shown in FIG. 21 . Also, among all of the text sections,the second text section may be highlighted.

As still another example, by selecting a piece of the summaryinformation, a text section indicated by the selected summaryinformation and also a key scene corresponding to the selected summaryinformation may be displayed or a playback time point may be shifted toan event time point corresponding to the selected summary information.

Referring back to FIGS. 22 and 23 , when “#2 ? 00:19: Tour programs,”which is a piece of summary information corresponding to the second textsection, is selected while the first key scene and the first textsection are being displayed, the second key scene and the second textsection may be displayed.

When there is a scroll bar as shown in FIG. 22 , scrolling of the textsection may be adjusted through the scroll bar, and a key scene or aplayback time point may be shifted corresponding to the text sectiondisplayed by the scroll.

may shift a key scene or a reproduction point so as to correspond to atext section displayed by scrolling.

<Multimedia Content Display Method>

A method for displaying multimedia content according to an embodiment ofthe present invention will be described below.

FIG. 24 is a flowchart of A method for displaying multimedia contentaccording to an embodiment of the present invention. Referring to FIG.24 , the method for displaying multimedia content may include acquiringmultimedia content (S110), displaying an image in a first area accordingto one of a video mode and a slideshow mode (S120), displaying text in asecond area (S130), and adjusting the displayed text according to thedisplayed image (S140). The above-described steps will be described indetail below.

First, the electronic device 1000 may acquire multimedia content (S110).The multimedia content may include video data, slide data, and commentdata.

Next, the electronic device 1000 may output an image in a first areausing the multimedia content (S120). In this case, the image may beoutput according to any one of the video mode and the slideshow mode. Inthe video mode, the electronic device 1000 may reproduce a video withreference to the video data. In the slideshow mode, the electronicdevice 1000 may display a key scene with reference to the slide data. Inthis case, the modes may be switched according to a user input or thelike.

While the image is being output, the electronic device 1000 may displaytext in a second area that is different from, or included in, the firstarea (S130). The text may be output with reference to the comment data.In detail, the output text may include a text section linked to an eventsection corresponding to a playback time point of the displayed keyscene or video among pieces of the comment data and may further includefollowing text sections. The second area may be included at a certainposition of the first area when the text is displayed in the form of asubtitle and may be positioned in a space separate from the first areawhen the text is displayed in the form of an article.

Next, the electronic device 1000 may adjust the text displayed in thesecond area according to the displayed image (S140). For example, in theslideshow mode, a text section linked to a key scene may be displayedwhile the key scene is being switched or may be displayed to havedifferent display attributes from other text sections. As anotherexample, in the video mode, a text section linked to an event section towhich a current playback time point belongs may be displayed while theplayback time point is being changed or may be displayed to havedifferent display attributes from the other text sections.

In S140, the displayed text may be adjusted through an operationincluding at least one of a scrolling, a up-and-down moving of the text,a up-and-down shifting of the page, and a page turning.

Conversely, when a user input an operation with regard to the text suchas a scrolling, a up-and-down moving of the text, a up-and-down shiftingof the page, and a page turning is received and the displayed textsection is changed, the image displayed in the first area may beadjusted. That is, a video scene or a key scene corresponding to anevent time point corresponding to the text section displayed in thesecond area may be displayed in the first area.

In addition to the text section of the comment data, summary informationregarding the text section may be displayed in the second area.

FIGS. 25 to 27 are diagrams showing still other examples of selecting akey scene according to an embodiment of the present invention.

Referring to FIG. 25 , the electronic device 1000 may reproduce thevideo data through the display-type output unit 1200. Here, the videodata may be output through a display window. In addition, a controlpanel for controlling the reproduction of the video data, a key sceneselection icon (an SC selection icon) for receiving a key sceneselection input, a progressive bar corresponding to a reproductionsection of the video data, and a playback time point indicator (a PBindicator) for displaying a progress time point of the reproduction ofthe video data in the progressive bar may be further included in thedisplay window.

While the video is being reproduced, the key scene selection input maybe received from a user through the input unit 1100. Here, the key sceneselection input may be performed through various methods of, forexample, clicking a predetermined button of the input unit 1100,touching a screen, or selecting the SC selection icon on the controlpanel of FIG. 25 .

When the key scene selection input is received, an event time point maybe determined on the basis of the key scene selection input. Forexample, the event time point may be a playback time point in areproduction section of the video when the key scene selection input isreceived.

As shown in FIG. 26 , the determined event time point may be displayedas the EV indicator for indicating the event time point on theprogressive bar.

When the event time point is determined, an image frame (a still image)of the video data corresponding to the event time point may be acquiredas a key scene. The image frame itself may be acquired as the key scene.However, the key scene may be acquired by processing the image frame ifnecessary.

The acquired key scene may be displayed in a key scene window (an SCwindow). In this case, the key scene may be displayed in the form of athumbnail. Also, a number of the key scene and an event time point (alsoreferred to as an EV time) for the key scene may be displayed.

When the key scene is selected, real-time reproduction of the video datamay be automatically stopped. Thus, a user may restart the reproductionof the video data by controlling a play button of the control panel orthe like.

When a plurality of key scene selection inputs occur while the videodata is being reproduced, a plurality of event time points may beselected, and a key scene may be selected for each of the event timepoints. Referring to FIG. 27 , it can be seen that four selected keyscenes are displayed in the SC window in the form of thumbnails.Likewise, as shown in FIG. 27 , it can be seen that the EV indicatorindicating four event time points are displayed in the progressive bar.Here, when a user selects any one of the key scenes in the SC window, aplayback time point of the video data may be shifted to an EV time ofthe selected key scene.

Multimedia content may be generated by linking key scenes selected inthis way to video data through an EV time thereof to generate slide dataas described above.

The operation of generating multimedia content by generating slide datafrom video data through a key scene selection input of a user has beendescribed. Now, an operation of acquiring and receiving commentsmatching an event time through a comment input from a user andgenerating comment data will be described.

Also, the key scene does not need to be determined as only a still imageof an image frame corresponding to an event time point. In some cases,at any event time point, a user may need to select an image frame ofvideo data corresponding to a time point that is different from theevent time point.

In this case, referring back to FIG. 30 , a key scene to be substitutedmay be selected first. The selection may be performed by selecting anyone key scene from the SC window. Next, a substitute scene for theselected key scene may be selected. As an example, the substitute scenemay be selected by reproducing the video data again and performing asubstitute scene selection input equivalent to the key scene selectioninput. Alternatively, the substitute scene may be selected by moving anevent indicator (EV) in the progressive bar. In this case, a scene thatdoes not correspond to an EV time may be selected as a key scene bychanging the EV time while maintaining the key scene.

When the substitute scene is selected, a key scene shifting may becompleted by changing the slide data so that a key scene correspondingto the EV time may be substituted with the substitute scene. Asubstitute time point of the substitute scene may be set only within apredetermined range from the event time point.

FIGS. 28 to 30 are diagrams showing an example of a comment datageneration operation according to an embodiment of the presentinvention.

Referring to FIG. 28 , the display-type output unit 1200 of theelectronic device 1000 may display a comment window (a CM window) inaddition to the display window for reproducing the video data and the SCwindow for displaying a selected key scene. Here, the CM window mayinclude a comment indicator (a CM indictor) that indicates a commentnumber and a comment input interface (a CM input interface) forreceiving or displaying details of a comment.

When a key scene is selected, a CM indicator corresponding thereto maybe generated. For example, as shown in FIG. 28 , when the key scene“scene #1” is generated for the event time “0:58.00,” the commentindictor “Comment #1” may be displayed in the CM window. Here, when textis received from a user through the CM input interface, the receivedtext may be acquired as a comment corresponding to a corresponding EVtime and key scene. Referring to FIG. 29 , when a user inputs text “Hi?Where are you going?” through the CM input interface, the text may beacquired as a comment for “Comment #1.”

Similarly, referring to FIG. 30 , when key scenes are generated for aplurality of event time points, a plurality of key scenes may beincluded in the SC window. Likewise, a plurality of CM indicators may bedisplayed in the CM window. In this case, when an input for selectingany one of the CM indictors is received from a user, a commentcorresponding to the selected CM indictor may be received. In FIG. 30 ,it can be seen that “Good to see you. Bye˜” is input as a second commentcorresponding to “scene #2,” which is a second key scene. In this case,a playback time point of the video data may or may not be shifted to anEV time corresponding to the selected CM indicator.

Through the above-described procedure, a comment may be input for eachevent time point. It should be appreciated that, in some cases, nocomment exists for some event time points because comments do not needto be input for every event time point.

When comments are acquired for event time points, multimedia content maybe generated by comment data being generated by matching the commentswith the event time points or key scenes corresponding to the event timepoints.

<Content Generation Method>

A multimedia content generation method according to an embodiment of thepresent invention will be described below.

First, the electronic device 1000 may acquire video data. In detail, thecontroller 1500 may read video data pre-stored in the memory 1400 or maydownload or stream video data from the outside through the communicationunit 1300. Here, the video data may be an image that is captured by acamera in real-time.

Next, the electronic device 1000 may reproduce the video data. Also, theelectronic device 1000 may acquire a key scene selection input for auser while the video data is being reproduced.

The electronic device 1000 may determine an EV time on the basis of thekey scene selection input. The EV time may be a playback time pointcorresponding to the acquisition of the key scene selection input in areproduction section of the video data.

When the EV time is determined, the electronic device 1000 may select akey scene on the basis of the determined event time point. The key scenemay be a still image corresponding to an image frame of the video datacorresponding to the event time point.

When key scenes are selected in this way, the electronic device 1000 maygenerate slide data by matching the key scenes with event time points,and thus may generate multimedia content.

In this process, a user may set a comment corresponding to each of thekey scenes. The comment may be set by selecting a CM indictor generatedaccording to the key scene. When text is input for the set comment,comment data may be generated by matching the text with a key sceneassociated therewith or an EV time of the key scene. Thus, it ispossible to generate multimedia content with comment.

<Multimedia Content Reproduction Operation>

The slideshow mode in which key scenes selected as described above aresequentially shown as still images will be described below.

In the slideshow mode, key scenes may be sequentially displayed as stillimages in a slideshow manner Here, the slideshow manner may refer to amethod for outputting a specified key scene as a still image and thenreceiving a user input or automatically outputting a following orpreceding key scene as a still image.

As described above, in the slideshow mode, a slide shifting function maybe provided to sequentially output key scenes.

FIG. 31 is a diagram showing a default screen for a content reproductionmethod according to an embodiment of the present invention.

Referring to FIG. 31 , a display window, a progressive bar, a controlpanel, a slide icon, and a bookmark icon may be included in a defaultscreen.

A key scene may be displayed in the display window as a still image.Also, in a portion of the display window, a subtitle region in which acomment is displayed may be positioned over the still image. It shouldbe appreciated that, in addition to a case in which a subtitle region ispresent and a subtitle using comment data is displayed in the subtitleregion in the video mode or the slideshow mode, a speech bubble may bedisplayed corresponding to a speaker who speaks a corresponding subtitlein an image and the subtitle may be displayed in the speech bubble.Also, icons for various kinds of user inputs (for reproducing, stopping,pausing, rewinding, and fast-forwarding a video) which are used in thevideo mode may be arranged on the control panel. Also, a barcorresponding to a reproduction time period of an entire video and anicon indicating a current playback time point on the bar are positionedon the progressive bar.

The slide icon may be positioned on left and right sides of the displaywindow. The slide icon is associated with a user input for performing aslide shifting during the slideshow mode. Also, the bookmark icon isassociated with a user input for a bookmark setting.

Various kinds of functions may be performed in the multimedia contentreproduction method through a user input or touch input selecting anicon provided by the default screen.

First, the video mode may be switched to the slideshow mode as follows.

When a user input selecting a slide icon is received from a user whilecontent is being reproduced in the video mode, the electronic device1000 may change a reproduction mode of the content from the video modeto the slideshow mode. In detail, when a user input selecting a rightslide icon is received, the slideshow mode is entered by displaying akey scene corresponding to a time point directly after a playback timepoint on the timeline corresponding to the reception in the video modeas a still image. When a user input selecting a left slide icon isreceived, the slideshow mode is entered by displaying a key scenecorresponding to a time point directly before a playback time point onthe timeline corresponding to the reception in the video mode as a stillimage.

Alternatively, when a horizontal drag touch input is applied in thevideo mode, the electronic device 1000 may switch the reproduction modeto the slideshow mode. FIG. 32 is a diagram showing a user input formode switching according to an embodiment of the present invention. Areproduction mode may be switched when a drag touch input is applied toa subtitle region. In detail, it may be determined that the drag touchinput is applied to the subtitle region when a start time point of thetouch input is within the subtitle region. Here, depending on ahorizontal movement direction of the drag touch input, whether to outputa key scene before or after a playback time point of a video on thetimeline as a still image may be determined when the slideshow mode isentered. For example, as shown in FIG. 32 , when a direction of thetouch input is rightward, a key scene after the playback time point onthe timeline at which the touch input is received may be output. FIG. 32also shows a selection of a slide icon for a slide shifting, and thusthe following description refers to FIG. 32 .

When the video mode is entered from the slideshow mode as describedabove, the default screen may be partially changed. As an example, theslideshow mode may have different comment attributes from the videomode. Comment attributes may refer to a font size, a color, a font type,and a display position of a comment. FIG. 33 is a diagram showing achange in comment attributes in the slideshow mode according to anembodiment of the present invention. As an example, referring to FIGS.32 and 33 , it can be seen that a font size of a comment is increasedwhen the slideshow mode is entered.

It is also possible to change from the slideshow mode back to the videomode. In this case, a video may be reproduced immediately from aplayback time point of a slideshow. Alternatively, the video may bereproduced from a time point a predetermined time interval before theplayback time point of a slideshow. Thus, the video may be naturallyreproduced.

In the slideshow mode, a slide shifting between key scenes may beperformed in a manner similar to the mode switching. In other words, theslide shifting may be performed by the slide icon being selected or ahorizontal drag touch being applied.

In the slideshow mode, a slide shifting between key scenes may generatea visual effect in which a screen is changed in a sliding way. FIG. 34is a diagram showing a visual effect of a slide shifting in theslideshow mode according to an embodiment of the present invention.Referring to FIG. 34 , when a drag touch input is received in theslideshow mode, a current key scene moves in a display window in adirection of the drag touch input, and a key scene to be displayed isoutput to an empty space caused by the slide shifting. In this case, themovement of the key scene is proportional to a length of the drag. Inthis case, when a movement distance of the key scene is greater than orequal to a predetermined distance, that is, when an end (a left end inFIG. 34 ) of the current key scene exceeds a predetermined boundary, theslide shifting is performed. Conversely, when the drag touch input endsbefore the slide shifting is performed, the slide shifting may not beperformed.

In the slideshow mode, a slide shifting between key scenes may beperformed in a different way from the above-description depending on adrag touch input.

For example, when the drag touch input is received in the displaywindow, a key scene may be shifted. In this case, a shifting rate may bedetermined depending on a length direction of the drag touch inputinstead of one key scene being shifted at a time. In detail, when thelength of the drag touch is less than or equal to a predeterminedlength, the key scene may not be shifted. When the length of the dragtouch is greater than or equal to the predetermined length, a currentkey scene may be shifted to a following key scene at a predeterminedinterval. As the length of the drag touch increases, the predeterminedinterval may decrease. Similarly, as the length of the drag touchincreases, the number of key scenes shifted may increase while thepredetermined interval is maintained.

FIG. 35 is a diagram showing an example of a slide shifting method inthe slideshow mode according to an embodiment of the present invention.Referring to FIG. 35 , a key scene shifting may be performed once persecond when a drag touch is applied up to a first drag point, and may beperformed ten times per second when the drag touch is applied up to asecond drag point. In this case, the key scene shifting may be performedwith a visual effect similar to a case in which a page of a paper bookis turned instead of a simple screen switch.

When the slide shifting is repeated, the final key scene among severalkey scenes may be output as a result. In this case, a user may beinformed that the current key scene is the final key scene through thedefault screen. For example, when the final key scene is reached, theelectronic device 1000 may omit a slide icon for shifting to a followingkey scene from the default screen. FIG. 36 is a diagram showing omissionof a slide icon in the slideshow mode according to an embodiment of thepresent invention. In FIG. 36 , it can be seen that the slide icon forshifting to a following key scene is not displayed as a result ofreaching the last key scene. Conversely, a slide icon for shifting to apreceding key scene may not be displayed while the first key scene isoutput.

Next, the bookmark setting will be described. FIG. 37 is a diagramshowing a bookmark setting in the slideshow mode according to anembodiment of the present invention. According to FIG. 37 , when a userinput selecting a bookmark icon of the default screen occurs, a bookmarkmay be set for a current playback time point in the video mode or theslide mode. When a bookmark is set in this way, a corresponding scene isset as a bookmarked key scene. Referring to FIG. 37 , it can be seenthat a bookmark is set for a comment for a corresponding key scene.

Also, a character input window for generating additional information maybe provided when a bookmark is set in this way. When a character stringis input into the window by a user, text may be displayed together witha corresponding comment. The text that is input as the additionalinformation may be displayed to have different comment attributes fromoriginal comments. When a bookmark is set for a position at which thereis no comment, a dummy comment is generated.

Various user interfaces may be used in addition to the method forselecting a bookmark button shown in FIG. 37 for bookmarking.

FIG. 38 is a diagram showing an example of a user interface for settinga bookmark in the slideshow mode according to an embodiment of thepresent invention. Referring to FIG. 38 , when a down-to-up touch inputis received in a display window, a key scene displayed in the displaywindow may be bookmarked.

The term “bookmarking” has been used herein, but is not to beinterpreted as a narrow meaning of bookmarking that is generally set formultimedia content. The term should be understood as an action ofstoring and recording a corresponding scene so that the correspondingscene may be managed separately from other key scenes.

A bookmark shifting using the bookmark that is set in this way may beperformed as follows. FIG. 39 is a diagram showing a touch input for abookmark shifting according to an embodiment of the present invention.The bookmark shifting may be performed according to a horizontal dragtouch input. Here, the bookmark shifting may be performed when a dragtouch input is applied to a subtitle region. However, such a drag touchinput may refer to a movement of a predetermined distance or more in thehorizontal direction. In other words, the above-described slide shiftingand bookmark shifting may be distinguished depending on a drag distance.For example, when a drag is performed for less than the predetermineddistance, the slide shifting may be performed. When the drag ismaintained for more than the predetermined distance, the bookmarkshifting may be performed. As in the case of the slide shifting, whetherto shifting to a preceding or following bookmark may be set according toa drag direction.

The electronic device 1000 may display a list of bookmarked key scenes.FIG. 40 is a diagram showing displaying of a bookmark list according toan embodiment of the present invention. Referring to FIG. 40 , in theslideshow mode, images of bookmarked key scenes may be listed anddisplayed. For example, when a vertical drag touch input is applied(e.g., in the downward direction), the electronic device 1000 may move adisplay window down according to a degree of the drag, list bookmarkedcore images in chronological order, and display the listed core imagesin an empty space in which the display window was positioned.

In this situation, when an image is selected from among the listedimages by a user, a playback time point may be shifted to the bookmarkedcore image, which is a still image, and the still image may bedisplayed.

When a horizontal drag touch occurs while the bookmarks are beingdisplayed, the listing of the bookmarks may be released.

Also, the electronic device 1000 may provide a function of browsing allevent time points having comments. FIG. 41 is a diagram showing abrowser for an EV time according to an embodiment of the presentinvention. Referring to FIG. 41 , in the slideshow mode, an eventbrowser in which event time points are listed may be displayed accordingto a user input. A double touch may be used as the user input. The eventbrowser may include start points, end points, and text details of allevent sections. Here, when a user input for selecting any one of thelisted event sections occurs, a playback time point may be shifted to atime point of a core image of the selected event section.

The above-described slideshow mode may be performed using contentpre-stored in the memory 1400 of the electronic device 1000. However, insome cases, the slideshow mode may be executed while data regarding thecontent is received from an external device in a streaming manner. Forexample, the data regarding the content may be transmitted through thecommunication unit 1300 of the electronic device 1000 from an externaldevice, and the electronic device 1000 may temporarily store the dataregarding the content in a buffer and reproduce the content whilereading the buffer.

Here, the electronic device 1000 may receive a still image of a keyscene to be displayed in the slideshow mode first. Generally, in a videostreaming service, image data for playing a video is sequentiallyreceived beginning with a playback time point. However, according to thepresent invention, a still image of a key scene may be transmittedearlier than image data is received. The still image of the key scenehas a much smaller size than a video. Accordingly, even when it isdifficult to reproduce content as a video due to a low transmissionrate, the electronic device 1000 may reproduce content in the slideshowmode by receiving a key scene first. To this end, the electronic device1000 may receive comment data first.

When still images of a key scene are acquired first as described above,the still images may be received in order from a still image closest toa current playback time point to smoothly play a slideshow.

<Content Reproduction Method>

A content reproduction method according to an embodiment of the presentinvention will be described below.

First, the electronic device 1000 may acquire content. In detail, thecontroller 1500 may read content pre-stored in the memory 1400 or maydownload content from the outside through the communication unit 1300.Here, the content may be image data. When the content is received in astreaming manner, still image data for a key scene may be downloadedbefore video data. In this case, the download may be performed in orderfrom a key scene closest to a current playback time point among keyscenes.

Also, the electronic device 1000 may acquire event information regardingevent time points. Here, an event is a concept including a dummy eventhaving an empty comment. Also, an EV time may refer to a start timepoint or end time point of an event section, and event information mayrefer to comment data. The controller 1500 may receive the comment datafrom an external device or may read comment data pre-stored in thememory 1400.

The electronic device 1000 may reproduce content in the video mode. Thecontroller 1500 may reproduce the content as a video by decoding thecontent with an appropriate video codec.

Also, the electronic device 1000 may reproduce the content in theslideshow mode. The electronic device 1000 may sequentially display keyscenes corresponding to EV times of the event information in theslideshow mode. Here, the key scene may be displayed as a still image,and the still image may be extracted from video of the content at theevent time point. Alternatively, when the content includes still imagesfor key scenes together with a video, the content may be reproduced in aslideshow manner by decoding the still images with a still image codec.

The video mode and the slideshow mode may be switched between. When thevideo mode is switched to the slideshow mode, the slideshow mode isentered by outputting a key scene closest to a playback time point inthe video mode as a still image. Conversely, when the video mode isentered from the slideshow mode, a reproduction in the video mode may bestarted at a playback time point of a key scene or a time point apredetermined time before or after the reproduction time period.

In the slideshow mode, a slide shifting between core images may beperformed, and this has been described above in detail.

The above description is merely illustrative of the technical spirit ofthe present invention, various modifications and changes may be made bythose skilled in the art without departing from the subject matter ofthe present invention. Accordingly, the above-described embodiments ofthe present invention may be implemented separately or in combination.

Therefore, the embodiments disclosed herein are intended not to limitbut to describe the technical spirit of the present invention, and thescope of the present invention is not limited to the embodiments. Thescope of the invention should be construed by the appended claims, andthe technical spirit within the scope of their equivalents should beconstrued as being included in the scope of the invention.

Mode of the Invention

As described above, relevant matters have been described in the bestmode for carrying out the invention.

INDUSTRIAL APPLICABILITY

As described above, the present invention may be entirely or partiallyapplied to a multimedia content generation and reproduction method, anelectronic device for performing the same, and a recording medium havinga program for executing the same stored therein.

1. A method for providing multimedia content, the method comprising:providing a user interface for receiving a first user input; receivingthe first user input from a first user; determining at least one timepoint information based on the received first user input; determining atleast one key scene image based on the determined time pointinformation; determining at least one summary text related to the timepoint information based on the received first user input; generating atleast one marked information based one the determined at least one timepoint information, at least one summary text and at least one key sceneimage, wherein each of the at least one marked information comprises oneof the at least one time point information, one of the at least onesummary text information corresponding to the one time point and one ofthe at least one key scene image corresponding to the one time point;displaying the at least one marked information for a second user;receiving, via the displayed at least one marked information, a seconduser input from the second user to select one marked information amongthe displayed at least one marked information; and determining aspecific time point based on the marked information selected based onthe second user input, wherein the specific time point is associatedwith time point information which is included in the selected sectioninformation.
 2. The method of claim 1, further comprising: displaying abar associated with the multimedia content; and displaying at least onemarked indicator on the bar, wherein each of the at least one markedindicator corresponds to each of the at least one marked information. 3.The method of claim 2, wherein a position of the at least one markedindicator on the bar is determined based on the time point informationof the corresponding marked information.
 4. The method of claim 1,further comprising: displaying the multimedia content while displayingthe at least one marked information.
 5. The method of claim 4, whereinthe multimedia content is displayed in a first window, and wherein theat least one marked information is displayed in a second window which isdifferent from the first window.
 6. The method of claim 1, whereindisplaying the at least one marked information comprises: displaying theat least one time point information, displaying the at least one summarytext information, and displaying the at least one key scene image. 7.The method of claim 1, wherein displaying the at least one markedinformation comprises at least: displaying a first marked informationcomprising first time point information, first summary text informationand a first key scene image; and displaying a second marked informationcomprising second time point information, second summary textinformation and a second key scene image.
 8. The method of claim 1,wherein the displayed at least one marked information is scrollable. 9.The method of claim 1, wherein the displayed at least one markedinformation is page-shiftable.
 10. The method of claim 1, furthercomprising: diminishing the displayed at least one marked informationaccording to a third user input.
 11. The method of claim 1, wherein thetime point information is earlier than a reproducing time of the keyscene image corresponding to the time point information.
 12. The methodof claim 1, further comprising: displaying a still image correspondingto the determined specific time point.
 13. The method of claim 12,wherein the still image is identical to the key scene image of themarked information selected based on the second user input.
 14. Themethod of claim 12, wherein the still image is different from the keyscene image of the marked information selected based on the second userinput.
 15. The method of claim 1, further comprising: reproducing themultimedia content from the determined specific time point.